AITopics | disagreement notion

Collaborating Authors

disagreement notion

Information about AI from the News, Publications, and Conferences

Automatic Classification – Tagging and Summarization – Customizable Filtering and Analysis

If you are looking for an answer to the question What is Artificial Intelligence? and you only have a minute, then here's the definition the Association for the Advancement of Artificial Intelligence offers on its home page: "the scientific understanding of the mechanisms underlying thought and intelligent behavior and their embodiment in machines."

However, if you are fortunate enough to have more than a minute, then please get ready to embark upon an exciting journey exploring AI (but beware, it could last a lifetime) …

Beyond Top-Class Agreement: Using Divergences to Forecast Performance under Distribution Shift

Schirmer, Mona, Zhang, Dan, Nalisnick, Eric

arXiv.org Artificial IntelligenceDec-13-2023

Knowing if a model will generalize to data 'in the wild' is crucial for safe deployment. To this end, we study model disagreement notions that consider the full predictive distribution - specifically disagreement based on Hellinger distance, Jensen-Shannon and Kullback-Leibler divergence. We find that divergence-based scores provide better test error estimates and detection rates on out-of-distribution data compared to their top-1 counterparts. Experiments involve standard vision and foundation models.

disagreement, disagreement notion, estimation, (15 more...)

arXiv.org Artificial Intelligence

2312.08033

Country:

Europe > Netherlands > North Holland > Amsterdam (0.04)
Europe > Portugal > Porto > Porto (0.04)
Europe > Germany > Baden-Württemberg > Tübingen Region > Tübingen (0.04)

Genre: Research Report (0.64)

Technology: Information Technology > Artificial Intelligence > Machine Learning (1.00)

Add feedback